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Abstract. We prove a measure-theoretic identity that underlies all transient 
fluctuation theorems (TFTs) for entropy production and dissipated work in 
inhomogeneous deterministic and stochastic processes, including those of Evans 
and Searles, Crooks, and Seifert. The identity is used to deduce a tautological 
physical interpretation of TFTs in terms of the arrow of time, and its generality 
reveals that the self-inverse nature of the various trajectory and process 
transformations historically relied upon to prove TFTs, while necessary for these 
theorems from a physical standpoint, is not necessary from a mathematical one. 
The moment generating functions of thermodynamic variables appearing in the 
identity are shown to converge in general only in a vertical strip in the complex 
plane, with the consequence that a TFT that holds over arbitrary timescales may 
fail to give rise to an asymptotic fluctuation theorem for any possible speed of 
the corresponding large deviation principle. The case of strongly biased birth- 
death chains is presented to illustrate this phenomenon. We also discuss insights 
obtained from our measure-theoretic formalism into the results of Saha et. al. on 
the breaJfdown of TFTs for driven Brownian particles. 



PACS numbers: 02.50.Ey, 05.70.Ln 



The Measure-theoretic Identity Underlying Transient Fluctuation Theorems 



2 



1. Introduction 

Fluctuation theorems have drawn a significant amount of research attention since 
their discovery over fifteen years ago [3 [TU] due to their apparent connection to 
irreversibiUty in nonequiUbrium processes. Whereas the second law states that the 
expected value of thermodynamic quantities such as entropy production and 
dissipated work must be nonnegative, these theorems reveal a symmetry in the 
actual probability distributions of these quantities, of which the nonnegative 
expectation is merely one consequence. Transient fluctuation theorems (TFTs), 
which provide concrete probabilities of second law violations in systems observed at 
finite length and time scales, have even been credited [33] as the resolution of 
Loschmidt's paradox: how microscopically reversible dynamics can give rise to 
macroscopically irreversible phenomena. 

In this paper we show that, beyond their known connection to the second law, 
TFTs in fact possess a tautological physical interpretation in terms of the arrow of 
time. This result rests on the derivation of a measure-theoretic identity that 
underlies all TFTs for entropy production and dissipated work, but not, notably, 
heat dissipation - the time-extensive current part of entropy production. In 
particular, we will see that entropy production and dissipated work satisfy the 
identity (and, hence, a TFT) solely because of their representation as logarithmic 
Radon-Nikodym derivatives, revealing that the self-inverse nature of the protocol 
[31 [TS], trajectory [21], driving field [2S] and process adjoint [SKU] transformations 
that has previously been relied upon to prove TFTs, while necessary for these 
theorems from a physical standpoint, is not necessary from a mathematical one. The 
identity underlying TFTs, in fact, permits general noninvolutive process and 
trajectory transformations that are unrelated to the irreversibility of the underlying 
process. 

As an example of the generality we claim for TFTs, consider a physical system 
represented in reduced coordinates by a continuous time Markov chain on the finite 
state space {1,2,..., N}, satisfying local detailed balance and driven by 
time-dependent, positive transition rates kij : [—t,t] ^ (0, oo). Suppose further that 
the system is initially prepared at time —t in an equilibrium distribution that 
satisfies strict detailed balance with respect to the rates kij{—t). It is a well-known 
result [31II2] that the TFT relation f{x)/f^{-x) = then holds between the 
probability density / of the dissipated work of this process (work done on the system 
that is not stored as free energy but released as heat) and the density of the 
dissipated work of the corresponding backward process, in which the sample paths 
and transition rates have been time-reversed. Surprisingly, however, the exact same 
relation holds when the transition rates of the backward process are replaced by an 
arbitrary driving protocol k[j : [— — > (0,oo) and the path-reversal transformation 
replaced by one which dices up a path according to an arbitrary finite partition and 
rearranges it, preserving right-continuity. While the first TFT appears related to the 
irreversibility of the original process, the second one clearly is not. 

Several advances have already been made in the pursuit of a generalized, or 
universal, TFT. In a sweeping series of papers, Maes and collaborators proved a 
moment generating function (MGF) symmetry for the entropy production of general 
classes of stochastically [H [Ml HI HIl and deterministically jH US] modeled 
homogeneous processes, in which entropy production was identified as the source 
term for time-reversal breaking in the process' action functional and found to equal 
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the logarithmic Radon-Nikodym derivative of the process' path measure with respect 
to itself, composed with a path-reversal transformation. Ge and Jiang later 
rigorously proved the corresponding distributional form of this symmetry which 
is the one most often found in applications and experimental studies of TFTs (see 
e.g., Refs. [71[THl[2nil3H])- The distributional form of the symmetry was generalized 
in a nonrigorous fashion by Crooks [3] to inhomogeneous stochastic processes 
satisfying local detailed balance [13 [21] via the introduction of a protocol-reversed 
process, and was generalized by Jarzynski [IS] to the case of inhomogeneous 
Hamiltonian systems connected to multiple thermal reservoirs. In their review 
paper, Harris and Schiitz [T^] generalized both forms of the TFT to the case of 
inhomogeneous Markov chains using a general functional on the Markov chain path 
space that consists of a current and boundary part [32] , which is able to represent 
various thermodynamic quantities depending on the choice of the latter. This 
flexibility allowed them to recreate a Markov chain version of many of the existing 
TFTs in the literature. 

The TFT identity we prove in this paper builds off and extends all of these results 
and subsumes all integral and transient fluctuation theorems proven to date, 
including those of Evans and Searles [HI [31] and Seifert [55] • Like existing TFTs, it 
can be expressed in both distributional and MGF form. It holds for the entropy 
production and dissipated work of all inhomogeneous deterministic and stochastic 
processes satisfying local detailed balance, including processes for which the 
distributions of these thermodynamic quantities are neither singular nor continuous 
with respect to Lebesgue measure. From the measure-theoretic formalism we use to 
prove the identity, however, it is clear that it does not in general hold for the heat 
dissipated by a process, a fact observed by van Zon and Cohen [35] in the context of 
driven Brownian particles. Similar reasoning yields intuition into some of the more 
recent results of Saha et. al. [30] . 

An additional result that follows from our analysis is that the MGFs of 
thermodynamic variables appearing in TFTs, presumed by previous studies to exist 
everywhere, in fact converge in general only on the vertical strip — 1 < Re(A) < in 
the complex plane. As we discuss in section 4, the failure of an MGF to converge in 
a neighborhood of the origin rules out the possibility of a large deviation principle 
for the associated variable, regardless of the speed, or time-scaling, used in its 
formulation. The implication is that thermodynamic quantities may satisfy a TFT 
over arbitrary timescales, and yet not satisfy an asymptotic fluctuation theorem 
(AFT), complementing our previous results on the breakdown of AFTs for even 
continuous and bounded driving protocols [H]. Note that this type of AFT 
breakdown is different from those considered by van Zon and Cohen [36], Baiesi et. 
al [1] and Rakos and Harris [29] , in which the time-averaged heat dissipation of a 
process satisfies a large deviation principle with linear speed, but whose rate 
function exhibits distinct, "extended" fluctuation symmetries over different regions 
of its domain. 

The rest of the paper is organized as follows. In section 2 we present our abstract 
formulation of the TFT identity, beginning with the definition of logarithmic 
Radon-Nikodym derivatives Sp and Sq, which take the place of Harris and Schiitz's 
generalized path functionals. Both forms of the identity as well as a mutual 
implication are then proved for these quantities, paying careful attention to the 
domain of convergence of the MGFs. In section 3 we identify Sp (resp. Sq) as either 
the entropy production or dissipated work of the forward (resp. backward) version of 



The Measure-theoretic Identity Underlying Transient Fluctuation Theorems 



4 



a process, depending on the choice of its boundary term, confirming that these 
thermodynamic quantities satisfy the TFT identity solely by virtue of their 
representation as a logarithmic derivative. This is followed by a discussion of the 
tautological physical interpretation of TFTs for homogeneous and inhomogeneous 
processes. In section 4 we switch gears to consider the breakdown of asymptotic 
fluctuation theorems due to the divergence of MGFs, illustrating with the example of 
strongly biased birth-death chains. Section 5 concludes with summary remarks. 



2. Abstract definitions and results 



Consider a pair of (nearly) arbitrary probability spaces (fi, J^, P) and {S,S,Q). 
While the theorems we will prove are entirely general, making no assumptions about 
the structure of {Q,J-) or {S,S), we will always have in mind the case in which 
{il, J-) = {S, S) and elements ui ^ fl are spacetime trajectories of some deterministic 
or stochastic process. In this scenario, P will play the role of the forward process 
measure and Q the protocol-reversed process measure, in which any inhomogeneities 
driving the forward process have been time-reversed. We assume the existence of a 
bimeasurable transformation : f2 — ^ 5 between the two sample spaces (i.e., ip and 
ip~^ are both measurable functions), whose action on w e f2 will be denoted ipui and 
is defined on sets A C fl hy ipA = {(poj : oj E A} and measures /i by 
(piJ,{A) = Ijl{ip{A)). Our central objects of interest will be the random variables 
Sp = log dP/d{(pQ) and Sq — log dQ / d{ip~^ P) , which generalize both entropy 
production and dissipated work under the forward and backward process, 
respectively. The precise connection between these variables and the physical 
quantities they represent depends on the initial distributions we assign to the 
forward and backward process measures, and will be addressed in section 3. 

Recall that we say a probability measure is absolutely continuous with respect 
to another probability measure and write <C i^, if i^iA) = implies ^i{A) = for 
all events A. We say that two such measures are equivalent, and write ^ ~ i', when 
the two are mutually absolutely continuous. When ^ and v are path measures, as is 
the case in this paper, this means that the two measures put positive probability on 
the same set of paths. We begin this section by introducing a lemma that 
demonstrates how composition with bimeasurable transformations preserves the 
absolute continuity of measures and affects the corresponding Radon-Nikodym 
derivative, which plays the role of a Jacobian between the two measures. The lemma 
will be an important symbolic tool in the theorems to follow because, loosely 
speaking, it allows us to replace a ip in front of Q with a ip^^ in front of P, and 
vice- versa. Note that statement (c) is a generalization of Lemma 2.1 in pT| . 

Lemma 2.1. Given the definitions above, the following three statements hold. 



(a) P<^Q=^>^-^P<Q (1) 

(b) P-(^Q ^ p-'P^Q (2) 

(c) P « =^ _^(^-i^) = ^^^^^(u;), Q-a.s. (3) 

Proof. Let ^ e 5 in what follows. If P < ipQ, then Q{A) = ipQ{ip-'^A) = 
=^ P(</5-iA) = =^ p-^P{A) = 0. This proves (a). Now taking ipQ < P, 
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<p-ip(A) = Piifi-'^A) = =^ Q{A) = ipQ{ip-^A) = 0, implying Q < ip-^P, and 
hence the forward imphcation of b) . Similar arguments yield the reverse implication. 
Finally, assuming P ^ ipQ, since dP/d{(pQ{(p~^ •)) is Q-measurable, 

J A d{ipQ) J^-iA a[ipQ) J^^iA 

which guarantees existence of the left-hand integral. We further have 

P{^-'A) = v-'P[A) = [ ^^^^(c.)dQ(u;), 

where the second equality follows from (a). By uniqueness of the Radon-Nikodym 
derivative up to sets of measure zero, the result follows. 

We now prove our first main result, the MGF form of our TFT identity, which 
generalizes the MGF symmetries of Maes et. al. and Harris and Schiitz. Note the 
mutual independence of the two measures and y?: neither the processes themselves 
nor the transformation between them need be related beyond a mutual absolute 
continuity assumption for the symmetry to hold. This is in contrast to existing 
results for inhomogeneous processes, for which the backward process Q is defined 
directly in terms of the original process P and path-reversal is often not replaceable 
by a more general transformation. The fact that ip is merely assumed to be 
bimeasurable is itself a new result, in particular, since all existing proofs of TFTs 
rely on the involutive, or self-inverse, nature of time reversal. 

Theorem 2.2 (MGF symmetry). Given probability spaces {n,J',P) and {S,S,Q) 
with a bimeasurable transformation ip : D, ^ S between them such that P ^ ipQ, 

Ep(e^^^)= EQ(e"(^+^^^«) for - 1 < Rc(A) < 0. (4) 

Proof. We first show existence of the generating functions. Expanding out their 
definitions. 



and 




by Jensen's inequality, where the derivative in ^ is justified by ([!]). Recall that by 
finiteness of the measures P and Q, the spaces U'i^P) and L^iQ) have the property 
that C for < pi <P2. Noting that d{ipQ)/dP G L^{P), we therefore have 
that d{ipQ)/dP € LP{P) for p e [0, 1], or, by equivalence of P and ipQ, 
dP/d{ipQ) G L^<^\P) for Re(A) e [-1,0]. Similarly, d{ip-'^P)/dQ e Lp{Q) for 
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p e [0, 1], and so d{ip-'^P)ldQ e Li+"<=(^)(Q) for Rc(A) e [-1,0]. This gives 
convergence of both MGFs for Re(A) G [—1,0]. For A in this domain, 



\d{^Q)' 7 d{ipQ) 



dP ^ 



(w) dQ{Lpuj) 



n\d{^Qy 7 (7) 

N 1 + A 



( 



dQ 

= EQ(e-(i+^)^«), 
where the final two equalities follow from (|3| and then 

The distributional form of the TFT identity is the one most often cited in 
applications and experimental studies of fluctuation theorems. Existing versions of it 
require the distributions of thermodynamic variables (our Sp and Sq) to be singular 
or continuous with respect to Lebesgue measure, but in our generalization below we 
relax this assumption to allow for more general processes whose distributions of 
these quantities may be more complicated. To state it, we define dF and dG to be 
the Lebesgue-Stieltjes measures corresponding to the distribution functions 
F{x) = P{Sp < x) and G{x) = Q{—Sq < x), respectively. 

Theorem 2.3 (Distributional symmetry). Under the conditions of Theorem 2.2, 

dF 

dF^dG and -^{x) = e"" (8) 
dG 

Proof. We first note that we may represent these measures as dF — dP o 5p ^ and 
dG = dQo [—Sq)^^. Given a Borel set A C R, invoking the lemmas as before yields 



/ dF{x) = P{Sp e A) 

J A 



dP 

= ^^^^"^^°^^(^)^^> 

dP 

= ^"^{-'^^^^°Sd(^(^"-')^^> 
= ^-ipVe5:log^^^^^(^')G^}, 

where in the final equality we have used (p^^P ^ Q to justify that (|3| holds 
{ip^^P)~a.s. By ((2|, the last expression equals 
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= I e^dQ{{-SQy\x)) = / e^dG{x). 

J A J A 

We therefore conclude dF <^ dG and dF/dG — e^ . By finiteness and strict positivity 
of the Radon-Nikodym derivative, however, it immediately follows that dG <^ dF, 
and so dG ^ dF. 



Corollary 2.4. When Sp and Sq both have continuous or discrete distributions 
under P and Q, respectively, then under the conditions of Theorem 1, 

P{Sp^x)^e-Q{SQ = -x). (9) 

Here P{Sp = x) and Q{Sq — —x) denote densities in the case of continuous 
distributions and probability mass functions in the case of discrete distributions. 



It was argued informally in Ref. [T2^ that the MGF form of the identity implies 
the distributional form. We rigorously prove this statement here, as well as its 
converse, when the real part of A is restricted to [—1,0]. This is not an a priori 
obvious fact, since classical statements of the uniqueness of MGFs require them to 
be defined in a neighborhood of the origin. We will see in section 4 that this domain 
of convergence cannot, in general, be extended. 



Theorem 2.5 (Equivalence of the MGF and distributional symmetries). 

dF 

dF^dG and — (a;)=e^ 
dG 

holds if and only if 

Ep(e^^^)= EQ(e-(^+^^^«) for - 1 < Re(A) < 0. 
This statement is not true if the domain of A is extended. 

Proof. Beginning with the reverse implication, we saw in the proof of Q that 
Ep(e^'5^) and EQ(e"(i+^)'^Q) exist for -1 < Re(A) < 0. For such values of A, 



Jr 

= EQ(e- 



/R 

,-(1+A)5q^ 



= / e(i+^)-dG(x) ^^^^ 



R 
R 



e^'dGix) 



We would like to identify the measures dF and e^dG, as this equality holds for a 
continuum of A values. To d o so , we begin by defining A' A + 1/2, d/x = e~''/^dF 
and dv = e^/2dG. Then, by /(A') = /j^e^'^d^(x) and g{\') = J^e^'''diy{x) 
exist and are equal in the closed strip —1/2 < Re(A') < 1/2. This domain contains 
the imaginary axis, on which /(—A') and g{—X') are the characteristic functions of n 
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and v, respectively. As characteristic functions uniquely determine their measures 
[3], we have ^ = v. The strict positivity of the exponentials in the definition of /i and 
V then implies that dF ~ dG, with dF/dG = e^ . The forward implication of the 
theorem is trivial by rearranging the equalities in (10), given the existence of the 
generating functions for Re(A) e [—1,0]. 

For the proof of why the mutual implication in the theorem does not remain valid 
if the domain of A is extended, we refer the reader to section 4.2, in which we discuss 
the example of a strongly biased birth-death chain run from time to t. The 
transition rates of the process are defined such that the forward measure P and 
backward measure i^Q of the process are equivalent, and so by Theorem 2.2, 
dF ^ dG with dF/dG — e^ . However, the MGF of Sp is shown to diverge for 
Re(A) > 0, which implies that, by equality ([7|), the MGF of Sq diverges for 
Re(A) < -1. 



3. Application to deterministic and stochastic processes 

3.1. Forward and backward processes 

Having proved general results for the abstract quantities Sp and Sq, our goal is 
now to connect them directly to the entropy production and dissipated work of 
deterministic and stochastic processes, in order to confirm that our TFT identity 
does indeed subsume the most general TFTs in the physics literature. To begin 
with, we must identify the building blocks of these quantities, the measures P and Q 
and the transformation Lp, as well as the measurable spaces {Vl^T) and {S,S) on 
which they are defined. 

Due to the generality of the class of processes we wish to consider, our definitions 
will be open-ended, (^i, J^) — {S,S) we take to be a measurable space of functions lo 
from [—t,t] to a state space in which the path space O may be, for example, 

C{[—t,t],E), (the Skorokhod space of right-continuous paths with left 

limits) or a Riemannian manifold, depending on the underlying dynamics. The 
measure P = P[-t.t] governs the forward (original) process, which in general depends 
upon a spacetime-dependent protocol A(a;, s) (a; € S and —t<s<t), and Q = ^ 
then governs the process in which the protocol has been time-reversed, ip = r we take 
to be an appropriately defined path-reversal involution (i.e., r~^ — i")) which may, for 
example, need to preserve right-continuity of paths or reverse the momentum 
coordinates of a Hamiltonian state space. The minimal requirement that this 
transformation be bijective between the supports of the measures ^"[-4,4] and Pj~ ^ 
is at times called "dynamic reversibility" [23] and "microscopic reversibility" |33j . 

The composition t] = ''"^[-t t] backward path measure, and may be 

interpreted as follows. For a subset A <zVl, as P[_t t](j4) is the probability of one of 
the spacetime curves in A being realized in a universe in which time runs forward 
from —t to i, jj {A) is the probability of one of those curves being realized in a 
universe in which time runs backward from t to —t. (For this reason we refer to ut as 
the initial state of the backward process, and a;_t the final state.) This is in contrast 
to the case of time-symmetric protocols (including, particularly, time-independent 
ones), in which P^^ i](^) = fP[-t.t]{-^) becomes simply the probability of observing 
the reverse of some lo ^ A as time moves in the usual forward direction. Equality 
between P[~t,t] ^nd rP[_t in the homogeneous case is how macroscopic reversibility 
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is usually defined. Note tliat microscopic reversibility amounts to equivalence 
between the measures P[-t,t] and ^j. 

It has been well-established that when local detailed balance is satisfied, the 
entropy production and dissipated work of inhomogeneous Markov chains [12 and 
the entropy production of homogeneous diffusions [13 123 ES] equal the logarithmic 
Radon-Nikodym derivative of their forward path measure with respect to their 
backward path measure, with suitably chosen initial distributions. Our goal here is 
to argue that this representation is universal and well-defined for the dissipated work 
and entropy production of general stochastic and deterministic processes satisfying 
local detailed balance. 

What distinguishes entropy production, dissipated work and dissipated heat in 
deterministic and stochastic processes are the initial distributions for the forward 
and backward path measures. This was first demonstrated in the case of Langevin 
processes and then later for Markov chains [12]. In order to define these 
quantities for the more general classes of processes to follow, we adopt the following 
terminology. Let s) = P[-t,t]{Xs € ■) denote the law of the forward process and 

s) — Pj^j {Xs G ■) the law of the backward process for s £ [—t, t], where 
Xs{uj) = LOs is the coordinate projection from il onto S. These measures must both 
be either continuous densities or discrete distributions V s in order for the system 
entropy log fi{Xs{uj), s) to be a well-defined quantity, and may therefore be obtained 
by solving Kolmogorov forward equations. Microscopic reversibility further implies 
that they have the same support, a condition sometime called ergodic consistency 
[3133]. For processes possessing a Hamiltonian H{x,s) — Hx(^x^s){x) on their state 
space, let fi*{dx,s) = exp[— P H {x , s)]dx / Z (s) denote the Gibbs measure 
corresponding to equilibrium when the protocol is held fixed in time at A(-, s), where 
(3 denotes a possibly non-physical inverse temperature of a connected thermal 
reservoir and Z{s) — Z^. s) the partition function corresponding to H{-, s). 



3.2. Entropy production 

The first claim we make is that Sp — logdP\^_i i^/ dP^^ equals the entropy 
production S{—t, t) of the forward process accumulated from time —t to t when local 
detailed balance is satisfied and we impose the boundary condition 

(BCi) ^l''{■,t) = ^i{■,t), (11) 

that is, when the forward and backward laws agree at the final time t. Indeed, this 
was first argued in Ref. [3] for general stochastic processes, proved later in the 
context of inhomogeneous Markov chains [H], and is consistent with later 
measure-theoretic [THl dSj |3S] and Onsager-Machlup [21! analyses of homogeneous 
diffusions. 

The argument for general Markov processes goes as follows. Coarse-graining the 
state space S of the process into discrete states i G Z, local detailed balance implies 
that for all times s £ [—t,t], 

P^hlA eP^Q(s)^ (12) 

where p{i,j^ s) is the rate of transitioning from i to j at time s and — A(5(s) is the 
heat which must be imported from a reservoir at inverse temperature /3 for the 
system to make this transition. For systems with a Hamiltonian, — A(3(s) = 
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H{j, s) — H{i, s) + AW{s), where AW{s) is the work that must be done against a 
nonconservative external force, such as an electric field in the presence of periodic 
boundary conditions |17| to make the transition happen. In the absence of 



nonconservative forces, AW{s) vanishes and (12) reduces to strict detailed balance 
with respect to H{-, s). For systems without a Hamiltonian, for whom a 
thermodynamic description is simply an idealization, AQ(s) has no meaning by 
itself, but pAQ{s) represents the entropy lost by the system as a result of the 
transition. This is analogous to phase space contraction in dissipative dynamical 
systems, discussed below. 

Multiplying terms of the form ( |12[ ) for every transition made from — t to t along a 
trajectory to (in addition to exponential holding time factors on top and bottom that 
cancel), we find that the net heat Q{—t,t) exported over the entire trajectory satisfies 

where we have conditioned the forward and backward measures on the initial and 
final state of the trajectory, respectively. Adding the net change in entropy of the 
system from —t to t 

^ n{X,{u),t) 

and using BCl, we find that the total entropy production 

S{~t, t) = PQ{-t, t) + AS = log jJS^^Ml . 

l-t.t] 

This confirms that our identity subsumes the TFTs for entropy production of 
Crooks [3] and Seifert |32;. Note that the above argument does not depend 
essentially on the coarse-graining of the state space S, used here for simplicity, and 
that continuous system movements are fine so long as the appropriate local detailed 
balance condition is satisfied. 

We now consider the case of a nonconservative deterministic process, driven by a 
time-dependent potential and/or external dissipative field, and possibly in contact 
with a Nose-Hoover or other deterministic thermostat, modulating fluctuations in 
momentum (see "37 for a thorough discussion). The path space is taken to be a 
smooth submanifold of S^^*'*! consisting of paths satisfying the thermostatted 
equations of motion, and the measures P[-t,t] a-nd arc induced directly from 

the initial distributions fi{-,—t) and iJ,^{-,t), which are presumed to possess densities 
/ and , respectively, with respect to the underlying Lebesgue measure on the 
manifold. The Evans-Searles dissipation function ^l{—t,t) [S] of the forward process, 
while defined originally only for homogeneous processes, becomes in our 
inhomogeneous setup 



'^^[-_M1 _ dfiiX^t, -t) _ f(X.u -t) 



t 



where A(Xs, s) = —d/dXg ■ Xg is the phase space compression factor. The first term 
on the RHS is the change in system entropy AS", and the second equals the net 
phase space contraction over the trajectory, which, for many choices of thermostat 
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[33], equals the outward entropy flux /3Q(—t,t). By the second law, we may therefore 
again conclude that Sp = ilp = S{—t,t). 

The identification of Sp with entropy production makes sense in two important 



respects. First, in light of (11), for each sample path w, Sp{u)) represents the 
log-likelihood of observing that path as time runs forward from —t to t rather than 
its reverse as time runs backward from t to —t, vanishing precisely when 
P[-t,t] = P[^t t] ~ that is, when there is no way to tell from observing the process 
whether time is moving forward or backward. Note that Sp vanishes if and only if 
Feng and Crooks' time asymmetry A — ^'H{P[-t,t]^ ^(^[-t.t] + ^[?t *]))+ 
g?^(P[_t,t]) 5(-P[-t,t] + P^^t t])) 0' ^ proposed measure of time's arrow, does. Second, 
the expectation Ep{Sp) — 'H{P[-t,t], P\Lt *]) is nonnegative, consistent with the 
second law of thermodynamics, and, as observed by Maes [21] , is equal up to 
coarse-graining corrections to the Gibbs entropy production of the process. 

BCl has an experimental connection to entropy production as well. Imagine that 
we observe a large number of realizations of a process and wish to determine whether 
the process is evolving forward or backward through time (i.e., whether the 
trajectories are being sampled from the forward or backward path measure). For a 
simple homogeneous example, suppose we observe the temperature profile of a slab 
of material evolve from a Gaussian of width ai at time —t to one of width (J2 < Ui at 
time t. This is consistent with standard diffusion, but under the backward, not 
forward, path measure governing the microscopic dynamics. To have generated the 
observed trajectories, the "initial" distribution /i^(-,i) of the backward path 
measure and the final distribution of the forward path measures must both equal the 
empirical one generated by the states of the trajectories at time i, precisely the 
boundary condition BCl. 

Having firmly established Sp as the entropy production of the forward process 
under BCl, the question remains whether its counterpart Sp- {Sq in section 2) 
equals entropy production under the backward process. While our TFT identity is 
valid for Sp- generally, only when this latter identification holds does our identity 
become a proper TFT for entropy production. In fact, it was shown first by Crooks 
[3] and then at greater length by Harris and Schiitz [T^] that the path functionals Sp 
and Sp- represent the same physical quantity under the forward and backward path 
measures, respectively, only when the initial distributions /i(-, — t) and /x^(-,t) turn 
into each other under a time-reversal of the protocol A(-, s). This occurs most 
generally when the initial distributions are solely functions of the driving protocol, 
locally in time. That is, there exists a function (j) such that ^{x, —t) = (j)(X{x, — t)) 
and iJ,^{x,t) = (l){X{x,t)). This includes the cases of equilibrium and nonequilibrium 
steady states, in which the protocol X{x,t) = X{x) is time-independent. To be clear, 
when we speak in this paper of a TFT for entropy production, we mean only the 
case when local detailed balance and BCl are satisfied and a protocol-to-distribution 
mapping (j) exists. 

Remark 3.1. 

In Ref. [3^, Saha et. al. employ the techniques of van Zon and Cohen [36] to 
show that for a Brownian particle in a harmonic potential and driven by an arbitrary 
time-dependent force, the entropy production only satisfies the TFT 

P[-t,t]{^Stot) ^ As,„, 

P[_t,*](-Ast„t) ^ ^ 
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if the particle is initially in thermal equilibrium. This is indeed a surprising fact 
because, based on our abstract results and the discussion above, one would never 
expect this TFT to be satisfied, but rather the TFT (|9|, with Q = P^^ and ip = r. 
The reason is that ( 14 ) fails to distinguish between both the forward and backward 
path measures and the forward and backward entropy productions, each of which are 
distinct due to the time-dependent driving. In fact, as the authors acknowledge, (14) 
holds in the case of equilibrium initial conditions only because of a coincidental 
relationship between the form of the equilibrium Gibbs measure and the harmonic 
potential. Any other potential or initial distribution - even an athermal Gibbs 
distribution - causes ( 14 ) to break down. It is therefore important that no general 
relationship between the validity of TFTs for entropy production and equilibrium 
initial conditions be inferred from this study. 

The situation is similar for another result proved by the authors, that the entropy 
production of a Langevin system prepared initially in a nonequilibrium state and 
allo wed to relax to equilibrium without external driving does not satisfy the TFT 
(14 1. Even in the absence of driving, the path measures P[-t,t] a-nd P\^t t] differ in 
their initial conditions - the nonequilibrium and equilibrium states, respectively - 
and therefore ^ does not reduce to ( 14 ) . The entropy production of the system 
would therefore not be expected to satisfy (14 1. 



3.3. Dissipated Work and Heat 

We now change boundary conditions so that the quantity Sp no longer equals the 
entropy production of the forward process, but its dissipated work - that is, the 
entropy that flows from the system to its surrounding reservoir as a result of work 
having been done on it. When multiplied by the temperature of the reservoir, this 
entropy flux equals the difference between the total work W{—t, t) done on the 
system + environment and the change in Helmholtz free energy of the system. Our 
new boundary conditions are 

(BC2) ^^(.,-t) = ^^*{■,-t) and ^i''{■,t) = fi*{;t), (15) 

which, in a laboratory experiment, implies preparing the system initially at 
equilibrium with respect to the Hamiltonian H{-,—t) and temperature j3~^. From 
our previous discussion, BG2 immediately implies that Sp and Sq represent the 
same physical quantity in their respective processes. We further have that the 
boundary term for Sp, replacing AS", equals 

log ^'*lfv'7/^ ^ PH{Xt,t) - l3H{X_t, -t) + log Z{t) ~ log Z{-t) 
= - /3AF, 

with Ai7 the microscopic energy change and /S.F the free energy difference between 
the equilibrium distributions at times t and ^t. Adding the current part j3Q{—t,t), 
which is justified by local detailed balance and ([l3]), 

logdP^_t,t]ldP^-t,t] = Pi^H + Q{-t, <)) - 13 AF = pW{-t, t) - /3AF, 

where the RHS is precisely the dissipated work. 

One might naturally assume that if the dissipated work l3W{—t, t) — f3AF of a 
system initially prepared in equilibrium and satisfying both microscopic reversibility 
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and local detailed balance satisfies a TFT, then so would its dissipated heat 
PQ{—t, t) = f3W{—t, t) — /3AH. In fact, it is the absence of the boundary term 
AS" = f3AH — f3AF in the latter variable that makes this statement false in general 
|321 112] , particularly in the case of a driven Brownian particle, as was observed by 
van Zon and Cohen In our generalized framework, writing Q{Q,t) for the heat 
dissipation of the forward process and Q^{0,t) for the backward process, the MGF 
symmetry Q with BCl implies that 



for —1 < Re (A) < 0. Thus a TFT for heat dissipation holds only if the random 
variables fi{X^t, —t) and fj,{Xt,t) are equal almost surely. But even in a 
nonequilibrium steady state in which the distributions ^{-j—t) and iJ.{-,t) are equal 
this will not be true, of course, because the microscopic states X_t and Xt will in 
general differ. We therefore expect van Zon and Cohen's observation that the heat 
dissipation of a driven Brownian particle does not satisfy a conventional TFT to 
hold for the great majority of processes. 

Example 3.2 (Inhomogeneous Ito diffusions in R''). 

This generalizes the case of homogeneous diffusions [El |23l [Til ISS] , but instead of 
studying their stationary entropy production as is typically done, we consider their 
dissipated work due to time-dependent driving. (For a more in depth, technical 
exposition on fluctuation theorems for multidimensional diffusions, see Ref. P].) Let 
dXs = b{Xs, s)ds + <j{Xs, s)dBs denote the stochastic differential of the forward 
process, whose drift vector b : IV^ x [— i, t] TV^ equals minus the gradient of a 
time-dependent potential H{x,s), to which the system is initially equilibrated at 
time —t, and where a : H'^ x [—t,t] — )■ MfixmC^), with Bg an m-dimensional 
Brownian motion. The only assumptions we make are that b and cr are continuous in 
time and satisfy the usual Lipschitz continuity requirements in space for a weakly 
unique solution ^28j . 

The protocol-reversed differential associated with the forward differential is 
dYg = b{Ys, —s)ds + a{Ys, —s)dBs, with initial condition t) = /i*(-,t) (i.e., 

BC2). This in turn yields the backward process Zg = Y-s, whose quadratic variation 
process [Z]s is identical to that of the forward process: Letting V — {tj}o<j<n 
denote a partition of [—t, s]. 



= j a{-,-ufdB^ = j a{:,ufdB,,^[X]s 

The Girsanov theorem therefore guarantees equivalence of P[-t.t\ to a measure P'_j 
which is identical to P^-t t\ except having initial distribution ^(•, —t). But 
dP[-t t\l '^^[^t t]^^) ^'^^^ equals ^{X-t{oj),—t)/fi*{Xt{uj),t), which is finite by the 
positivity of Gibbs measures, and so we conclude P[~t,t] ^ P[-t t] ^ ^[-t t] ■ "^^^^ 
confirms that the dissipative work satisfies a TFT. 

Note that the forward path measure will not in general be equivalent to either the 
protocol-reversed or path-reversed path measures, as it is in the homogeneous 
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diffusion case, because their corresponding quadratic variation processes do not 
coincide. This imphes that the usual TFT P{Wd = z)/P{Wd = -z) = for 
dissipated work will not hold. 



3.4- Tautological interpretation of transient fluctuation theorems 

Consider equation Q, which is the distributional form of the TFT identity for 
virtually all processes of relevance in physics - those whose thermodynamic variables 
have a discrete or continuous distribution. With the identifications P = P[_( jj, 
Q = Pj^j and ip = r made in section 3.1, and using Lemma 2.1, 

( d(rP^ 
dP-tA 



implying that ([9| can be re-expressed as 

Recalling the discussion in section 3.2, this equation states the following tautology: 
"Spacetime curves that are times more likely to be realized in a forward-time 
universe than a backward-time universe [i.e., {w S 51 : ^ogdP^_t t^/dP^^ t]('^) ~ ^}] 
are times more likely to be realized in a forward-time universe than a 
backward-time universe." The TFT identity, and hence the thermodynamic TFTs it 
generalizes, are therefore simply mathematical representations of a self-evident 
statement. This is true in particular for the case of homogeneous processes, in which 
-f[Zt t] ~ (niodulo boundary terms) and the familiar TFT 

has the interpretation that "trajectories that are more likely to be observed than 
their time-reversals are more likely to be observed than their time-reversals." 

If one is to ascribe nontrivial content to TFTs, therefore, it cannot be to the 
theorems themselves, which are "obvious", but to the fact that the thermodynamic 
variable in question can be represented as a logarithmic Radon-Nikodym derivative. 
This, after all, is the distinction between the entropy and dissipated work of a 
process and its dissipated heat, with only the former two satisfying a TFT in general. 
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4. Domain of convergence of the MGF and breakdown of asymptotic 
fluctuation theorems 

4.I. Definition and breakdown of AFTs 

It was proved in section 2 that the MGF of entropy production in the forward 
process, Ep(e^'^^°'*)), is only guaranteed to converge for — 1 < Re(A) < 0, a fact 
missed by previous studies. The significance of this fact is that processes for which 
this function does not converge in a neighborhood of the origin cannot satisfy an 
AFT. To see this, recall that the entropy production of a homogeneous process 
{Xt)t>o (i.e., one that is driven time-independently) satisfies an AFT with speed 
ip{t) when the quantity S{~'t,t)/ip{t) satisfies a large deviation principle (LDP) with 
speed (p{t) [34], whose corresponding rate function I{z) satisfies the 
Gallavotti-Cohen symmetry I{z) — I{—z) = —z. Here ip{t) is some monotonically 
increasing continuous function satisfying ip{t) oo as t ^ co, and I{z) is a 
nonnegative, lower semi-continuous function such that for all intervals A C R, 

lim ^ logP(A:f e A) = - inf I{z). 

t-i-oo ip(t) z€A 

The Gallavotti-Cohen symmetry is the infinite time analogue of ([9]), which held only 
for the finite time distribution of entropy production. Just as the rate function 
generalizes the finite time distribution of S{—t,t), the free energy 

c(A)= lim ^logEp(e^'^(^*'*)) 

generalizes its MGF. It is in the relationship between the rate function and free 
energy that the domain of the MGF becomes relevant. 

By Varadhan's theorem [37], the Legendre-Fenchel transform of I{z) yields c(A). 
This implies that if the MGF of S{—t, t) does not exist in a neighborhood of the 
origin for large t, then the free energy does not exist there either for any choice of ip, 
meaning that I{z) is not defined in a neighborhood of its minimum z* , which would 
otherwise be the almost sure limit of S{—t,t)/tp{t). (When c(A) is differentiable at 0, 
z* = c'(0) and the time-averaged entropy production converges exponentially to this 
value [II].) As it is precisely the existence of the rate function in a neighborhood of 
z* that guarantees almost sure convergence to this value (i.e., the strong law of large 
numbers) as well as the distribution of fluctuations about it [M], this scenario 
corresponds to a breakdown in the LDP, and hence the AFT. 

In fact, even though it has been shown that the heat dissipation Q{—t, t) of a 
process does not in general satisfy a TFT, the argument above holds for it as well. 
In this case, the failure of the MGF of Q{—t, t) to exist in a neighborhood of A = 
results in the breakdown of an AFT for the time-averaged heat dissipation and, 
hence, the time-averaged entropy production (due to the finiteness of the boundary 
term A^), despite the fact that the latter satisfies a TFT over arbitrary timescales. 
We consider this situation in the detailed example below. 



4-2. Example: Strongly biased birth-death chains 

4-2.1. The model To illustrate how the divergence of the MGF for heat 
dissipation can come about, we consider the example of a continuous-time 
birth-death chain Xt on the nonnegative integers j > 0, representing the dynamics of 
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a population. The chain hops from site j to j + 1 with rate pj and left to j — 1 with 
rate qj , corresponding to a birth or death in the population, respectively. For later 
simplicity, we define the process only on the time interval [0,oo), with Xq = 0, so 
that the reversal of the path segment a;|[o_t] € D(0,t) is r(w)s = lim.s>^t-s i-^s' , which 
preserves path right-continuity. None of our results are affected by defining the 
process on the halfiine instead of all of R. We further take pj + qj = 1 so that the 
mean holding time at every site is 1 second, and restrict the argument A of the MGF 
to the real axis, since the free energy, at least as it is employed in large deviation 
theory, is defined only on the reals. Note that the former constraint implies that the 
process makes only a finite number of hops almost surely in a finite time interval, so 
as long as we take pj > ioi j > and qj > for j > 1 , the forward and backward 
path measures restricted to that interval will be equivalent. 

Following Lebowitz and Spohn and our discussion in section 3, Q(0,t) is 
incremented by logpj /qj-^.l every time the particle hops right from j and logqj/pj-i 
every time it hops left. The rate in the denominator refers to the corresponding 
reversed movement in the backward process. That Q{0,t) only depends on the final 
state Xt can be seen by noting that of the Nt hops made until time t, exactly 
{Nt — Xt)/2 rightward ones from j to j + 1 are compensated by leftward ones from 
j + 1 to j, whose contributions to Q{0,t) cancel. What remains are contributions 
made from rightward hops at the first Xt sites, so that 

Xt-l 

Q(0,i)=log n (16) 
The MGF for Q{0,t) can therefore be written as 



= J2PiNt^n)J2PiXt^k\Nt=n)[Yl^) +Co, (17) 

where Cq represents the contribution from the k = term in the inner sum, which is 
independent of A and t. As this constant factor does not affect any of our results for 
the free energy, which only depends on derivatives and scaled limits of Mq(A, t), we 
omit it from future calculations. 

We consider two choices for the rates pj , qj , each of which biases the chain toward 
the right. The first choice, Pj/qj ~ a > 1, we will show, results in a convergent MGF 
about the origin and a valid AFT for (5(0, t) for all t > 0. It is a simple illustration 
that AFTs can apply to processes that not only do not possess a limiting stationary 
distribution (whether strict, periodic or quasistationary), but are non-recurrent. 
This is also a special case of the AFT proved in Ref. [T3] for non-Markovian simple 
random walks. For the stronger bias Pj/qj = 2-' , on the other hand, we show that the 
MGF fails to exist for A > and so no LDP is satisfied for any choice of (p{t). In 
essence, what fuels the breakdown in this case is that the typical irreversibility of 



trajectories consisting of arbitrarily large numbers of hops, represented, via (16), by 
their heat dissipation, dwarfs their improbability under P. 

4.2.2. Constant Bias We begin with the case Pj/qj = a > 1 for j > 1, with the 
boundary condition pq = 1 and qo = 0. These rates might correspond to a 
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population of cells whose common division rate is a times greater than their 
common death rate. The constraint Pj + qj — 1 corresponds to slowing down the 
dynamics for larger populations, an effect which does not alter our analysis as all 
waiting times have canceled in the definition of (5(0, t). In light of the constraint 
Pj + qj — 1, we have pj = a/ {a + 1) and qj — 1 / {a + 1) , implying by ( 16 ) that 
Q(0, t) = log[a^*-i(a + 1)] for Xt > 1 and Q(0, t) = for Xt = 0. 
To prove a LDP, we show that the free energy 



cq(A) 



lim - log MQ{X,t) 



(18) 



exists and is differentiablc, indicating a simple linear speed for the LDP. We begin 
by bounding |AfQ(A,t)| = MQ{X,t) above and below by exponentials in t (with 
prefactors) to confirm that the speed (p{t) — t. Using the fact that Nt is Poisson with 
intensity t, our upper bound is 



MQ{x,t) = — E^(^* = ^1^* = + 1))' 



< e 



n=0 
t 



k=l 



E 



^ in-l)\ 

n=0 ^ ' 



[a + iy 



so that 



t{a + 1)^ exp[-i + t{a + 1)^], 



lim sup- log Mq (A, i) < (a + 1)^ - 1. 

f — f oo t 



Keeping only the k = n terms in ( 19 1 and noting that 
we have the lower bound 



(19) 



(20) 



(21) 



implying that 



uniformly in A. 



MQiX,t) > 



n=0 



cxp 



1 a 
lim inf- log Mq (A, t) > — 

t->-oo t a 



- 1 

l+A 
1 



n=0 



1 /ta 



l+A \ " 



- 1 



- 1 > -1, 



n! \ a + 1 



(22) 



Together, (20) and (22) verify that if the limit (18) exists, the speed (p(t) must 
equal t. We establish this limit by proving that | log MQ{X,t) is monotonically 
increasing in t for large t, and therefore converges to a finite value, bounded above 
by the limsup To this end, define A/^(A,i) to be the MGF of (3(0, t) with 
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respect to the process which begins at site 1 instead of 0. It is easy to show that 
MQ{X,t) satisfies the backward equation 

-A/Q(A,t) =poe^'°'-Afi(A,t)-AfQ(A,t) = (a + l)^M^i\,t) - Mgi^t). 

Since MQ{X,t) and MQ{X,t) can difi'er Vi at most by (1 + a)^, corresponding to the 
heat released by an immediate jump fi'om to 1 at t = 0, and both grow to infinity 

as t ~> oo. 



d_ 
dt 



\ogMQ{\t) = {a + lY -\ + o{l), 



where the o(l) term vanishes in this hmit. But by the strict inequahty in (20), there 
exists an e > such that logMQ(A,t) < t{{a + 1)-^ 
that 



d_ 
dt 



log Mq (A, 



> 1 {t{{a + 1)^ - 1 + o{l))-t{{a + 1)^ - 1 - e)) = 



1 — e) for large t. This implies 
e + o(l) 



which is nonnegative for large t - exactly what was required. 

Having established convergence of the free energy VA € R, we now turn to its 
differentiability. As cq(A) is convex and differential operators commute with limits 
of convex functions, upon taking a derivative of (18 1, we may pass the operator 
through the limit and ultimately to the MGF inside. The derivative of this infinite 
sum is then evaluated term-wise, which is justified once it is clear that the resulting 
sum converges absolutely and uniformly on compact sets: 



e-* 5] ^ ^ P{Xt = k\Nt = n)(a^-i(a + l))^og(a^-i(a + 1)) 

n=0 ■ k = l 
,^[t(a+l)^]" ^ ^ 

Local uniform convergence clearly holds (by the Ratio Test, for instance), and so we 
may conclude that the free energy cq(A) is differentiable. 



MQ{\t) 



4-2.3. Strong Bias Having proved a LDP and associated AFT for the constant 
bias case, we now show that for the exponentially biased rates Pj/qj — 2^ , no LDP is 
possible for any choice of speed ip{t). This is a somewhat surprising result, since one 
might suspect that no matter how fast heat is dissipated by a process, there exists a 
time scaling under which the distribution of its fluctuations has a weak limit, 
analogous to a central limit theorem. Interestingly, the MGF exists and a LDP is 
satisfied even for the linearly increasing bias Pj/qj — j, although there is no simple 
representation of the LDP speed for these rates. 

In the present case, the rates can be solved as Pj = 2^ / (2^ + 1) and qj = 1/(2^ + 1) 
(again, with pq = 1 and qo = 0) , whose associated heat dissipation by time t is 

Xt-l 

Q(0,i)-log(2^'+l) II V. 
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Keeping only the k — n term in its definition (|17|) and recalling the first equality in 



(21 1, we obtain the following inequality for MQ{X,t): 



mq(a, = e — e ^(^* = = ( + 1) n 2^' 

i=i 



Defining 77 = f]^. 



2*^+1 



> 0, 



fc=i 



fe-i 



(23) 



logyyl = 



Elog 

fc=0 



1 - 



1 



2'^^ + 1 



E 

k=0 



c 



2^ + 1 2! (2^ + 1)2 



< 00, 



where C is the appropriate coefficient in the exact 2"'^-order Taylor expansion of 
log(x). We therefore see that 77 is finite, and so Mq(A, t) > e^* t"a„(A), where 

the sequence a„ (A) ~ r?n"=i 2^Vj tends to infinity V A > 0. Therefore MgiX^t) 
diverges Vt > for A > 0, and we are done. 



As we remarked earlier and can be seen in (23), the divergence of the MGF in the 



strong bias case comes from the domination of the exponential heat dissipation term 
n"=i 2'^^ over the 1/n! term that weights the probability of a trajectory with n hops 
by time t. Physically, this means that the typical heat dissipation associated with 
the tail event in which the system hops a large number of times over a finite time 
interval dwarfs the improbability of that event, leading to the divergence of all of its 
moments. 



5. Conclusion 

The abstract results of this paper imply several consequences for the 
interpretation of TFTs. First and foremost, the mathematical identity underlying 
TFTs, represented in its distributional form by the fluctuation symmetry ([9]), is a 
very general one. As demonstrated in Theorems 2.2 and 2.3, it holds for logarithmic 
Radon-Nikodym derivatives between processes that need have no relation to each 
other than to put positive probability on the same set of paths - hence the example 
in the introduction. In particular, the fluctuation symmetry does not require the 
processes to be related by a protocol, trajectory or fleld reversal, or any other 
self-inverse "reversal" transformation employed in physics derivations of TFTs, in 
order to hold. 

The generality of the fluctuation symmetry can even be taken a step further. 
While the fluctuation symmetry does not hold in general for the heat dissipated by a 
process, which cannot be represented as a logarithmic derivative, in the case of 
entropy production and dissipated work the symmetry merely expresses a 
self-evident statement in terms of the arrow of time. If one is to ascribe meaning to 
TFTs for these quantities, and therefore to the second law of thermodynamics which 
they imply as a consequence, it must be to the representation of the two 
thermodynamic variables as logarithmic derivatives. This puts a very different face 
on Loschmidt's paradox, which has always been cast as a dynamics problem, rather 
than one of mathematical representation. 
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Another result that comes out of Theorem 2.2 is that the MGFs of the 
thermodynamic variables appearing in the MGF form of the identity are not 
guaranteed to exist in an open neighborhood of the origin. As the detailed example 
of strongly biased birth-death chains demonstrated, this can lead to a breakdown in 
the LDP of the thermodynamic variable in question under every possible 
time-scaling, and hence a breakdown of the associated AFT. The implication is that 
the fluctuations of a variable may satisfy a TFT over arbitrarily timescales, but the 
fluctuations of its time-average would not satisfy an AFT. 
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